Papers with Text-to-SQL semantic parsing
Improving Text-to-SQL Semantic Parsing with Fine-grained Query Understanding (2022.emnlp-industry)
Copied to clipboard
Jun Wang, Patrick Ng, Alexander Hanbo Li, Jiarong Jiang, Zhiguo Wang, Bing Xiang, Ramesh Nallapati, Sudipta Sengupta
| Challenge: | Recent research on Text-to-SQL semantic parsing relies on parser or heuristic based approach to understand natural language query. |
| Approach: | They propose a general-purpose, modular neural semantic parsing framework that is based on token-level fine-grained query understanding. |
| Outcome: | The proposed framework outperforms the state-of-the-art model by 2.7% on a WikiTableQuestions test set. |
Improving Generalization in Semantic Parsing by Increasing Natural Language Variation (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing approaches generate question reformulations via models trained on Spider or only introduce local changes. Existing methods generate question form reformulation but lack robustness. |
| Approach: | They use data augmentation to enhance the robustness of text-to-SQL parsers against natural language variations by generating more realistic and diverse questions. |
| Outcome: | The proposed model improves on the new spider dataset by using a few prompts. |
Optimizing Deeper Transformers on Small Datasets (2021.acl-long)
Copied to clipboard
Peng Xu, Dhruv Kumar, Wei Yang, Wenjie Zi, Keyi Tang, Chenyang Huang, Jackie Chi Kit Cheung, Simon J.D. Prince, Yanshuai Cao
| Challenge: | a common belief that training deep transformers from scratch requires large datasets is wrong . however, with proper initialization and optimization, the benefits of very deep transformer can carry over to challenging tasks with small datasets. |
| Approach: | They train 48 layers of transformers from pre-trained RoBERTa and 24 relation-aware layers from scratch. |
| Outcome: | The proposed scheme achieves state-of-the-art performance on a text-to-sql parsing benchmark . it uses 24 fine-tuned layers from pre-trained RoBERTa and 24 relation-aware layers from scratch . |
A Tale of Two Linkings: Dynamically Gating between Schema Linking and Structural Linking for Text-to-SQL Parsing (2020.coling-main)
Copied to clipboard
| Challenge: | Existing methods for text-to-SQL semantic parsing require strict structured prediction due to its application scenario where the output SQL will be sent to an executor program directly. |
| Approach: | They propose to use schema linking and structural linking to link NL to the database schema. |
| Outcome: | The proposed method shows significant gains on the Spider dataset. |
Improving Retrieval-augmented Text-to-SQL with AST-based Ranking and Schema Pruning (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for text-to-SQL semantic parsing are limited to retrieving schemata based on a single query. |
| Approach: | They propose a text-to-sql semantic parser that uses abstract syntax trees to select few-shot examples for retrieval-augmented generation. |
| Outcome: | The proposed model can generate approximated versions of SQL queries in parallel, and shows improvements over state-of-the-art benchmarks. |